Management of resources within a computing environment

ABSTRACT

Resources in a computing environment are managed, for example, by a hardware controller controlling dispatching of resources from one or more pools of resources to be used in execution of threads. The controlling includes conditionally dispatching resources from the pool(s) to one or more low-priority threads of the computing environment based on current usage of resources in the pool(s) relative to an associated resource usage threshold. The management further includes monitoring resource dispatching from the pool(s) to one or more high-priority threads of the computing environment, and based on the monitoring, dynamically adjusting the resource usage threshold used in the conditionally dispatching of resources from the pool(s) to the low-priority thread(s).

This application is a continuation of co-pending U.S. Ser. No.15/356,893, entitled “MANAGEMENT OF RESOURCES WITHIN A COMPUTINGENVIRONMENT,” filed Nov. 21, 2016, which is a continuation of U.S. Pat.No. 9,501,323, entitled “MANAGEMENT OF RESOURCES WITHIN A COMPUTINGENVIRONMENT,” issued Nov. 22, 2016, which is a continuation of U.S. Pat.No. 9,021,495, entitled “MANAGEMENT OF RESOURCES WITHIN A COMPUTINGENVIRONMENT,” issued Apr. 28, 2015, which is a continuation of U.S. Pat.No. 9,021,493, entitled “MANAGEMENT OF RESOURCES WITHIN A COMPUTINGENVIRONMENT,” issued Apr. 28, 2015, each of which is hereby incorporatedherein by reference in its entirety.

BACKGROUND

An aspect of the invention relates, in general, to processing within acomputing environment, and in particular, to facilitating managingresources within the computing environment to be used in execution ofthreads.

A thread typically exists within a process, and a process may havemultiple threads that share resources, such as memory. A thread isconsidered the smallest unit of processing that can be scheduled by anoperating system. A thread can execute on a processor with no otherthreads executing thereon or on a processor with other threads. In thecase where the thread is the only thread executing on the processor, theprocessor is said to be executing in single thread mode. However, in thecase in which the thread is executing with other threads, the processoris said to be in simultaneous multithreading (SMT) mode.

In simultaneous multithreading mode, hardware resources are shared amongmultiple software threads executing on a machine. Each thread appears tohave its own complete set of architecture hardware. Furthermore, insuperscalar processors, it is common to have multiple executionpipelines that can be shared among the threads being dispatched into thehardware. Though SMT provides an efficiency of hardware, allowingmultiple threads to rapidly share the execution resources available, itcomes with a performance cost of the individual threads. It is commonfor a thread that is alone on a processor to execute more rapidly thanif that thread shared resources with another thread. This is becausewith SMT there may be resource contention issues between threads.

SUMMARY

Shortcomings of the prior art are overcome and additional advantages areprovided through the provision of a computer program product forfacilitating managing of resources in a computing environment. Thecomputer program product includes a computer readable storage mediumreadable by a processing circuit and storing instructions for performinga method. The method includes controlling, by a hardware controller,dispatching of resources from at least one pool of resources to be usedin execution of threads. The controlling includes conditionallydispatching resources from one pool of resources of the at least onepool of resources to at least one select-priority thread of thecomputing environment based on usage of resources in the one pool ofresources relative to a resource usage threshold associated with the onepool of resources. The one pool of resources comprises resources of oneselected type of resource.

Computer systems and methods relating to one or more aspects of thepresent invention are also described and may be claimed herein. Further,services relating to one or more aspects of the present invention arealso described and may be claimed herein.

Additional features and advantages are realized through the techniquesof one or more aspects of the present invention. Other embodiments andaspects of the invention are described in detail herein and areconsidered a part of the claimed invention.

BRIEF DESCRIPTION OF THE DRAWINGS

One or more aspects of the present invention are particularly pointedout and distinctly claimed as examples in the claims at the conclusionof the specification. The foregoing and other objects, features, andadvantages of one or more aspects of the invention are apparent from thefollowing detailed description taken in conjunction with theaccompanying drawings in which:

FIG. 1A depicts one embodiment of a computing environment to incorporateand use one or more aspects of the present invention;

FIG. 1B depicts further details of the central processors of FIG. 1A, inaccordance with an aspect of the present invention;

FIG. 2 depicts another embodiment of a computing environment comprisingone or more processors executing multiple threads using resources in oneor more pools of resources, the dispatching of which is controlled, inaccordance with one or more aspects of the present invention;

FIG. 3 depicts one embodiment of multiple pools of resources to be usedin execution of threads and illustrates resource usage thresholdsassociated with the pools for use in separately managing dispatching ofresources in the pools, in accordance with one or more aspects of thepresent invention;

FIG. 4A depicts one embodiment of logic for managing dispatching ofresources from one or more pools of resources used in execution ofthreads, in accordance with one or more aspects of the presentinvention;

FIG. 4B depicts one embodiment of logic for adjusting dispatching ofresources from one pool of the one or more pools of resources to one ormore low-priority threads of the computing environment, in accordancewith one or more aspects of the present invention;

FIG. 4C depicts one embodiment of logic for dynamically adjusting theresource usage threshold employed in triggering the adjustingdispatching of resources to the one or more low-priority threads, inaccordance with an aspect of the present invention; and

FIG. 5 depicts one embodiment of a computer program productincorporating one or more aspects of the present invention.

DETAILED DESCRIPTION

Note that as used herein, dispatching of hardware resources occurs whenan instruction for a particular thread is dispatched. As used below, thedispatching of a resource is thus employed synonymous with the dispatchof an instruction. The types of resources dispatched are based on thetype of instruction dispatched, and the resources of each type are saidto exist in a resource pool of that resource type.

One embodiment of a computing environment to incorporate and use one ormore aspects of the present invention is described with reference toFIG. 1A. A computing environment 100 is based, for instance, on thez/Architecture® offered by International Business Machines Corporation,Armonk, N.Y. The z/Architecture® is described in an IBM Publicationentitled, “z/Architecture—Principles of Operation,” IBM® Publication No.SA22-7832-08, Ninth Edition, August 2010, which is hereby incorporatedherein by reference in its entirety. In one example, a computingenvironment based on the z/Architecture® includes a System z® serveroffered by International Business Machines Corporation, Armonk, N.Y.IBM®, z/Architecture® and System z®, as well as z/OS® mentioned below,are registered trademarks of International Business MachinesCorporation, Armonk, N.Y. Other names used herein may be registeredtrademarks, trademarks or product names of International BusinessMachines Corporation or other companies.

As one example, computing environment 100 includes a central processorcomplex (CPC) 102 coupled to an input/output (I/O) subsystem 120.Central processor complex 102 includes, for instance, one or morepartitions 104 (e.g., logical partitions LP1-LPN), one or more centralprocessors 106, a hypervisor 108 (e.g., a logical partition manager),and a system controller 110, each of which is described below.

Each logical partition 104 is capable of functioning as a separatesystem. That is, each logical partition can be independently reset,initially loaded with an operating system, if desired, and operate withdifferent programs. An operating system or application program runningin a logical partition appears to have access to a full and completesystem, but in reality, only a portion of it is available. A combinationof hardware and firmware keeps a program in a logical partition frominterfering with a program in a different logical partition. This allowsseveral different logical partitions to operate on a single processor ormultiple physical processors in a time-sliced manner.

As used herein, firmware includes, e.g., the microcode, millicode,and/or macrocode of the processor. It includes, for instance, thehardware-level instructions and/or data structures used inimplementation of higher level machine code. In one embodiment, itincludes, for instance, proprietary code that is typically delivered asmicrocode that includes trusted software or microcode specific to theunderlying hardware and controls operating system access to the systemhardware.

In this particular example, each logical partition has a residentoperating system 112, which may differ for one or more logicalpartitions. In one embodiment, operating system 112 is the z/OS®operating system, offered by International Business MachinesCorporation, Armonk, N.Y. Further, in this example, each logicalpartition has assigned thereto a portion of system main storage(memory), which is referred to as a zone.

A logical partition 104 includes one or more logical processors. Eachlogical processor may have a central processor 106 permanently allocatedthereto, or there may be a pool of central processors 106 available fordynamic allocation to any group of logical processors, possibly spanningmultiple logical partitions 104.

Logical partitions 104 are managed by hypervisor 108 implemented, forinstance, by firmware running on processors 106. Logical partitions 104and hypervisor 108 each comprise one or more programs residing inrespective portions of main storage associated with the centralprocessor. One example of hypervisor 108 is the ProcessorResource/Systems Manager™ (PR/SM), offered by International BusinessMachines Corporation, Armonk, N.Y.

Central processors 106 are coupled to, but separate from, systemcontroller 110. System controller 110 is, for instance, a hardwarecomponent that controls access to memory and caches within the centralprocessors, and communicates between the central processors andinput/output subsystem 120. The system controller is responsible for thequeuing, serialization, and execution of requests made by the centralprocessors and the I/O subsystem. In one example, it is responsible forsending commands to particular central processors and/or broadcastingcommands to multiple central processors. The system controller may be acentralized component or its functions may be distributed. The systemcontroller is not a processor or core; for example, it does not executeuser applications. Instead, it is the communications mechanism betweenthe I/O subsystem and the central processors.

Further details regarding central processors 106 are described withreference to FIG. 1B. In one example, a central processor 106 includesone or more cores or processors 150, which are the physical processorsthat are allocated to one or more logical partitions. A centralprocessor is considered part of a node, and each node includes one ormore central processors. A logical partition can span nodes in which oneor more central processors from one node and one or more centralprocessors from another node can be assigned to the logical partition.

Further, in accordance with an aspect of the present invention, the oneor more processors 150 of the central processor 106 each include acontroller 151 (e.g., hardware controller) used to monitor theprocessors, and in particular, the threads executing on that processorand, in one embodiment, the pool(s) of available execution resources152, such as available hardware registers, being accessed by thethreads. The controllers 151 control dispatch of resources from therespective pools of resources 152 to threads, such as low-prioritythreads.

In one embodiment, the computing environment of FIGS. 1A & 1B may beimplemented with out-of-order processors. Out-of-order processors breakprocessing of instructions into multiple steps, with the goal ofallowing a processor to avoid a class of stalls that occurs when dataneeded to perform an operation is unavailable. The out-of-orderprocessors fill such time slots with instructions that are ready toexecute, and then re-order the results at the end to present theappearance that the instructions were processed in order.

Out-of-order processors require a significant amount of architectedhardware resources to achieve high performance. A code executing in athread determines the amount of system resources necessary to achievehigh performance. The more system resources required to achieve highexecution performance, the larger the out-of-order window the processoris said to have. In other words, in code where there is a high degree ofdependency (e.g., results of instruction A are needed in computation ofinstruction B), the more instructions will be in-flight for thatprocessor, and the more hardware resources will be consumed by thatthread during execution. Furthermore, certain threads executing in aprocessor may be high-priority threads requiring high performance or lowexecution latency, and certain threads may be low-priority threads (suchas, for example, a payroll computation that may only need to complete aparticular job over the course of weeks). Coarse-grained thread prioritymay be used in software to schedule threads based on the priority of thetask at hand, but once a thread is sent to execute on hardware, thevarious threads are traditionally dispatched to system hardwareresources with similar priority, that is, regardless of any relativepriority between the threads.

Disclosed herein is a facility for managing resources of a computingenvironment, aspects of which may be implemented as a computer system,method or computer program product, as described further herein. Themanagement facility includes controlling, by a hardware controller,dispatching of instructions for a particular thread based on thepriority of that thread and the resources available in the processorwhere the thread is executing. Once an instruction for a particularthread is dispatched into the issue queue, resources from the respectivepool(s) of available resources (such as a pool of hardware registers)are dispatched for that instruction's execution, making those resourcesunavailable for other instructions that need to dispatch. If theresource pool for a particular resource type (such as a physicalfloating point register) is empty at the time and instruction is readyto dispatch, that instruction is stalled at dispatch until an executinginstruction using the resource completes execution, freeing up thatresource. Avoiding dispatch stalling of high-priority threads is, in oneaspect, addressed by the management protocol presented herein. Thecontrolling includes conditionally dispatching instructions on alow-priority thread based on the resources needed by that instructionand the amount of resources available in the respective pool(s) ofresources. The threshold of available resources for each resource poolmay be adjusted dynamically to maximize system performance whileminimizing dispatch stalling of high-priority threads.

In particular, resource management may include monitoring dispatching ofresources from the one pool of resources to at least one high-prioritythread of the computing environment, wherein the at least onehigh-priority thread has a higher priority than the at least onelow-priority thread, and based on the monitoring, dynamically adjustingthe resource usage threshold associated with the one pool of resourcesand used in the conditionally dispatching of resources from the one poolof resources to the at least one low-priority thread. In oneimplementation, such a management facility is employed in a computingenvironment comprising out-of-order processors.

More particularly, disclosed herein is a management facility where oneor more pools of available hardware resources are monitored bycontroller hardware. Once the in use hardware resources for a particularresource pool rises above a respective threshold, which is automaticallydynamically configured by the processor to maximize processor throughputwhile avoiding dispatch stalling of high-priority threads, dispatch ofresources to low-priority threads is modified in order to facilitatereserving the remaining resources in the pool for use in execution ofone or more high-priority threads. This modified resource dispatch tothe low-priority thread is facilitated by delaying, or momentarilystalling, the dispatch of the instruction for the low-priority thread.Dispatch stalling the low-priority thread does not reduce, and mayincrease, the dispatch rate of the high-priority threads by allowing thehigh-priority thread(s) to use the dispatch cycle the low-prioritythread would have used. The duration of the stalling of the low-prioritythread is such that resource stalls are minimized for a high prioritythread, yet starvation of execution resources to the low-priority threaddoes not result in failure of that thread to make proper forwardprogress. Note that as used herein, dispatch is where instructions aredispatched into the issue queue and hardware resources are allocated toinstructions, and those instructions are then said to be in-flight. Asthe instructions in-flight complete and hardware resources free up, thenthe in use system resources will drop below the resource usagethreshold, and dispatch of the low-priority threads can return tonormal. In one embodiment of this concept, the controller hardware couldmomentarily halt dispatching of low-priority threads when currently inuse resources in a particular pool of system resources rises above therespective threshold, or alternatively, the controller or dispatchhardware could throttle a dispatch rate of those resources tolow-priority threads, which has the advantage of not completely stoppingdispatch of low-priority threads, thereby avoiding starvation of thosethreads (which would result in failure to make forward progress on thelow-priority threads).

FIG. 2 is a further depiction of one embodiment of a computingenvironment 200, such as the computing environment described above inconnection with FIGS. 1A & 1B. In this depiction, multiple threads 212,214 are to execute on one or more processors 210. In order to execute,the threads require the controller 216 to provide resources from one ormore pools of resources 220 provided for use in the execution of thethreads. In this embodiment, the multiple threads 212, 214 include oneor more high-priority threads 212, and one or more low-priority threads214. As used herein, a high-priority thread has a higher priority than alow-priority thread, and refers to a thread requiring high performanceor low execution latency. A “low-priority thread” refers to a thread forwhich low execution performance or high execution latency is acceptable.Thread priority is assigned to a thread by the operating system,middleware, or kernel, depending on the type of system, and is oftenuser and system-defined. For example, a user may wish to specify when athread is high-priority (such as a thread running an algorithm for stocktrading), whereas a second thread is low-priority (such as a thread forpayroll processing). By way of example, the kernel may then add an evenhigher-priority thread, for example, for critical device drivers.

As illustrated in FIG. 3, the pools of available system resources maycomprise multiple pools of hardware resources 300, including a floatingpoint register pool 310, a general purpose register pool 320, an issueregister pool 330, and a store buffer pool 340. Each pool of availableresources 310, 320, 330 & 340 has an associated resource usage threshold311, 321, 331 & 341, respectively, each of which may be an adjustablethreshold, as described herein. Note also that, as illustrated in FIG.3, each pool may comprise a different amount of resources, and theresource usage thresholds associated with the pools may, initiallyand/or by operation of the adjustment process disclosed herein, be atdifferent percent levels in the different pools.

In one embodiment, the respective resource usage thresholds of thevarious pools of resources are dynamically adjusted. This is because theoptimum threshold level for any given resource pool depends on thenature of the high-priority thread(s) being executed, and thread naturecan vary significantly from one workload to the next. For example, ifthe high-priority thread(s) does not execute floating pointinstructions, then restricting dispatch of a low-priority thread becausethe pool of floating point registers 310 (FIG. 3) has reached theresource usage threshold 311, would reduce performance on thelow-priority thread and provide no benefit to the high-prioritythread(s).

One example of a dynamically adjustable threshold approach would be onethat starts at a default threshold level of, for example, 90%, meaningthat 90% of each pool of resources at the start is available tolow-priority threads, such that the low-priority threads do notinitially incur any dispatch throttling. The dispatch rate of thehigh-priority thread(s) is monitored using, for example, a counter whichcounts the average number of dispatches for the thread per cycle. If ahigh-priority thread makes little use of a particular resource type(such as a floating point register, for example), then that thresholdlevel can be incrementally increased by, for example, one or moreregisters (or resources) at a time, over a period of a certain number ofclock cycles, for example, 1024. Note that the number of clock cycles inthe period of threshold adjustment may be a programmable setting, andthe incremental adjustment may be based on performance tests for thetype of workload for which the machine is being used, or based onreal-time measurements. Alternatively, if the high-priority threadheavily utilizes a particular resource, or incurs a stall due toresource contention on a given resource, then the threshold level forthat resource pool may be incrementally decreased, for example, by oneor more registers (or resources) at a time. In this case, thelow-priority thread(s) is in the dispatch throttled state, and remainsin that state until the number of resources in the contended resourcepool falls back below the adjusted resource usage threshold. If thehigh-priority thread continues to undergo resource contention for aprogrammable period of time, for example, 1024 clock cycles, then thethreshold on that contended resource pool can continue to fall until,for example, it reaches a programmable minimum level, such as 25% of thetotal pool size. These programmable settings may be set up in advance atmachine initialization, or may be part of a greater dynamic loadbalancing system or control.

FIGS. 4A-4C depict one embodiment of logic, in accordance with one ormore aspects of the present invention.

Referring to FIG. 4A, the hardware controller initiates, STEP 400,management processing by monitoring current usage of resources in one ormore pools of available resources, STEP 405, such as the above-discussedpools of system registers illustrated in FIG. 3. Based on the monitoringof current resource usage, the controller determines whether todynamically adjust dispatching of resources from one or more of thepools to low-priority threads being executed, STEP 410. FIG. 4B depictsone embodiment of such processing.

Referring to FIG. 4B, the controller begins, STEP 430, with determiningwhether current resource usage in the pool is above the pool's resourceusage threshold, STEP 435. If “yes”, then the controller begins orcontinues with dynamic throttling of a dispatch rate of resources fromthat pool to one or more low-priority threads, STEP 440, which completesthe dynamic adjustment of dispatching, STEP 455. If current resourceusage in the pool is not above the pool's resource usage threshold, thenprocessing ceases any throttling of resource dispatching from the poolto low-priority threads, STEP 450, before completing, STEP 455. Notethat in accordance with this processing, once the dispatch rate isthrottled, the low-priority threads remain in a dispatch throttled stateuntil the current resource usage falls back below the pool's resourceusage threshold.

Continuing with the logic of FIG. 4A, processing monitors resource usagein the pool by high-priority threads, STEP 415, and based on themonitoring of high-priority resource usage, determines whether todynamically adjust one or more usage threshold levels associated withthe pools of resources, STEP 420. One embodiment if this logic isdepicted in FIG. 4C.

Referring to FIG. 4C, processing begins, STEP 460, by determiningwhether the high-priority thread(s) has encountered resource contentionfor a resource in a particular pool, STEP 465. If “no”, then that pool'sassociated resource usage threshold may be incrementally increased, STEP470, which completes the dynamic adjustment processing, STEP 475.

As described above, resource contention, or more generally, dispatchrate, of the high-priority thread(s) may be monitored using a counterwhich counts the average number of dispatches for the thread per cycle.If the high-priority thread encounters no resource contention despite agiven resource usage threshold having been reached for a pool, then thatthreshold can be incrementally increased by (for example) one or tworesources at a time over a period of a certain number of clock cycles(with the clock cycles being a programmable setting). The desiredincremental increase (which in another embodiment may be a number ofresources other than one or two) may be based on performance tests ofthe types of workloads for which the machine is being used or, forexample, based on real-time measurements. Note that in this example,increasing the pool's resource usage threshold may depend on whether thelow-priority thread(s) is currently in a dispatch throttle state. Thatis, if the low-priority thread(s) is not currently being throttled, thenthere may be no need to increase the pool's resource usage threshold. Inanother embodiment, the types of resources used by a high-prioritythread may be monitored to determine if the resource threads in theresource pools should be adjusted over time. For example, if aparticular thread makes heavy usage of floating point registers andlight usage of fixed point registers, then the resource threshold for afloating point register pool may be decreased, and the threshold for afixed point register pool may be increased.

Assuming that the high-priority thread did encounter resource contentionfor a resource from the pool, then processing inquires whether thatpool's resource usage threshold is at a predefined or programmed minimumlevel, STEP 480, and if so, no action is currently taken, STEP 485.Otherwise, processing decreases the pool's resource usage threshold toenhance the likelihood of throttling the dispatch rate of resources fromthe pool to the low-priority threads, STEP 490. This completes thresholdlevel adjustment processing for a pool, STEP 475. Note that in oneembodiment, the processing of FIGS. 4A-4C may occur separately inparallel for each pool of system resources (such as hardware registers)being employed in execution of the multiple threads.

As will be appreciated by one skilled in the art, one or more aspects ofthe present invention may be embodied as a system, method or computerprogram product. Accordingly, one or more aspects of the presentinvention may take the form of an entirely hardware embodiment, anentirely software embodiment (including firmware, resident software,micro-code, etc.) or an embodiment combining software and hardwareaspects that may all generally be referred to herein as a “circuit,”“module” or “system”. Furthermore, one or more aspects of the presentinvention may take the form of a computer program product embodied inone or more computer readable medium(s) having computer readable programcode embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readablestorage medium. A computer readable storage medium may be, for example,but not limited to, an electronic, magnetic, optical, electromagnetic,infrared or semiconductor system, apparatus, or device, or any suitablecombination of the foregoing. More specific examples (a non-exhaustivelist) of the computer readable storage medium include the following: anelectrical connection having one or more wires, a portable computerdiskette, a hard disk, a random access memory (RAM), a read-only memory(ROM), an erasable programmable read-only memory (EPROM or Flashmemory), an optical fiber, a portable compact disc read-only memory(CD-ROM), an optical storage device, a magnetic storage device, or anysuitable combination of the foregoing. In the context of this document,a computer readable storage medium may be any tangible medium that cancontain or store a program for use by or in connection with aninstruction execution system, apparatus, or device.

Referring now to FIG. 5, in one example, a computer program product 500includes, for instance, one or more non-transitory computer readablestorage media 502 to store computer readable program code means or logic504 thereon to provide and facilitate one or more aspects of the presentinvention.

Program code embodied on a computer readable medium may be transmittedusing an appropriate medium, including but not limited to, wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for one or moreaspects of the present invention may be written in any combination ofone or more programming languages, including an object orientedprogramming language, such as Java, Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language, assembler or similar programming languages. Theprogram code may execute entirely on the user's computer, partly on theuser's computer, as a stand-alone software package, partly on the user'scomputer and partly on a remote computer or entirely on the remotecomputer or server. In the latter scenario, the remote computer may beconnected to the user's computer through any type of network, includinga local area network (LAN) or a wide area network (WAN), or theconnection may be made to an external computer (for example, through theInternet using an Internet Service Provider).

One or more aspects of the present invention are described herein withreference to flowchart illustrations and/or block diagrams of methods,apparatus (systems) and computer program products according toembodiments of the invention. It will be understood that each block ofthe flowchart illustrations and/or block diagrams, and combinations ofblocks in the flowchart illustrations and/or block diagrams, can beimplemented by computer program instructions. These computer programinstructions may be provided to a processor of a general purposecomputer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the instructions,which execute via the processor of the computer or other programmabledata processing apparatus, create means for implementing thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

The flowchart and block diagrams in the figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of one or more aspects of the present invention. In thisregard, each block in the flowchart or block diagrams may represent amodule, segment, or portion of code, which comprises one or moreexecutable instructions for implementing the specified logicalfunction(s). It should also be noted that, in some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts, or combinations of special purpose hardware andcomputer instructions.

In addition to the above, one or more aspects of the present inventionmay be provided, offered, deployed, managed, serviced, etc. by a serviceprovider who offers management of customer environments. For instance,the service provider can create, maintain, support, etc. computer codeand/or a computer infrastructure that performs one or more aspects ofthe present invention for one or more customers. In return, the serviceprovider may receive payment from the customer under a subscriptionand/or fee agreement, as examples. Additionally or alternatively, theservice provider may receive payment from the sale of advertisingcontent to one or more third parties.

In one aspect of the present invention, an application may be deployedfor performing one or more aspects of the present invention. As oneexample, the deploying of an application comprises providing computerinfrastructure operable to perform one or more aspects of the presentinvention.

As a further aspect of the present invention, a computing infrastructuremay be deployed comprising integrating computer readable code into acomputing system, in which the code in combination with the computingsystem is capable of performing one or more aspects of the presentinvention.

As yet a further aspect of the present invention, a process forintegrating computing infrastructure comprising integrating computerreadable code into a computer system may be provided. The computersystem comprises a computer readable medium, in which the computermedium comprises one or more aspects of the present invention. The codein combination with the computer system is capable of performing one ormore aspects of the present invention.

Although various embodiments are described above, these are onlyexamples. For example, computing environments of other architectures canincorporate and use one or more aspects of the present invention.Further, a central processor may include more or less processors thandescribed herein. Yet further, processors may include more or lessthreads than described herein. Yet further, the processors need not bepart of a central processor. Many other changes may also be made.

Further, other types of computing environments can benefit from one ormore aspects of the present invention. As an example, an environment mayinclude an emulator (e.g., software or other emulation mechanisms), inwhich a particular architecture (including, for instance, instructionexecution, architected functions, such as address translation, andarchitected registers) or a subset thereof is emulated (e.g., on anative computer system having a processor and memory). In such anenvironment, one or more emulation functions of the emulator canimplement one or more aspects of the present invention, even though acomputer executing the emulator may have a different architecture thanthe capabilities being emulated. As one example, in emulation mode, thespecific instruction or operation being emulated is decoded, and anappropriate emulation function is built to implement the individualinstruction or operation.

In an emulation environment, a host computer includes, for instance, amemory to store instructions and data; an instruction fetch unit tofetch instructions from memory and to optionally, provide localbuffering for the fetched instruction; an instruction decode unit toreceive the fetched instructions and to determine the type ofinstructions that have been fetched; and an instruction execution unitto execute the instructions. Execution may include loading data into aregister from memory; storing data back to memory from a register; orperforming some type of arithmetic or logical operation, as determinedby the decode unit. In one example, each unit is implemented insoftware. For instance, the operations being performed by the units areimplemented as one or more subroutines within emulator software.

As a further example, a data processing system suitable for storingand/or executing program code is usable that includes at least oneprocessor coupled directly or indirectly to memory elements through asystem bus. The memory elements include, for instance, local memoryemployed during actual execution of the program code, bulk storage, andcache memory which provide temporary storage of at least some programcode in order to reduce the number of times code must be retrieved frombulk storage during execution.

Input/Output or I/O devices (including, but not limited to, keyboards,displays, pointing devices, DASD, tape, CDs, DVDs, thumb drives andother memory media, etc.) can be coupled to the system either directlyor through intervening I/O controllers. Network adapters may also becoupled to the system to enable the data processing system to becomecoupled to other data processing systems or remote printers or storagedevices through intervening private or public networks. Modems, cablemodems, and Ethernet cards are just a few of the available types ofnetwork adapters.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprise” (andany form of comprise, such as “comprises” and “comprising”), “have” (andany form of have, such as “has” and “having”), “include” (and any formof include, such as “includes” and “including”), and “contain” (and anyform contain, such as “contains” and “containing”) are open-endedlinking verbs. As a result, a method or device that “comprises”, “has”,“includes” or “contains” one or more steps or elements possesses thoseone or more steps or elements, but is not limited to possessing onlythose one or more steps or elements. Likewise, a step of a method or anelement of a device that “comprises”, “has”, “includes” or “contains”one or more features possesses those one or more features, but is notlimited to possessing only those one or more features. Furthermore, adevice or structure that is configured in a certain way is configured inat least that way, but may also be configured in ways that are notlisted.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below, if any, areintended to include any structure, material, or act for performing thefunction in combination with other claimed elements as specificallyclaimed. The description of the present invention has been presented forpurposes of illustration and description, but is not intended to beexhaustive or limited to the invention in the form disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the invention.The embodiment was chosen and described in order to best explain theprinciples of one or more aspects of the invention and the practicalapplication, and to enable others of ordinary skill in the art tounderstand one or more aspects of the invention for various embodimentswith various modifications as are suited to the particular usecontemplated.

What is claimed is:
 1. A computer program product for facilitatingmanaging of resources in a computing environment, the computer programproduct comprising: a computer readable storage medium readable by aprocessing circuit and storing instructions for performing a methodcomprising: controlling, by a hardware controller, dispatching ofresources from at least one pool of resources to be used in execution ofthreads, the controlling comprising: conditionally dispatching resourcesfrom one pool of resources of the at least one pool of resources to atleast one select-priority thread of the computing environment based onusage of resources in the one pool of resources relative to a resourceusage threshold associated with the one pool of resources, wherein theone pool of resources comprises resources of one selected type ofresource; monitoring dispatching and dispatching rate of resources fromthe one pool of resources; and based on the monitoring, dynamicallyadjusting the resource usage threshold associated with the one pool ofresources.
 2. The computer program product of claim 1, wherein theselect-priority thread is a low-priority thread, and wherein theresource usage threshold indicates a level at which dispatching oflow-priority threads is to at least be throttled.
 3. The computerprogram product of claim 2, wherein the conditionally dispatching ofresources from the one pool of resources comprises dynamicallythrottling a dispatch rate of resources from the one pool of resourcesto the at least one low-priority thread based on the usage of resourcesin the one pool of resources exceeding the resource usage thresholdassociated with the one pool of resources.
 4. The computer programproduct of claim 3, wherein the conditionally dispatching of resourcesfrom the one pool of resources further comprises discontinuing thethrottling of the dispatch rate of resources to the at least onelow-priority thread based on the usage of resources in the one pool ofresources dropping below the resource usage threshold associated withthe one pool of resources.
 5. The computer program product of claim 1,wherein the one pool of resources comprises resources exclusively of theone selected type of resource.
 6. The computer program product of claim1, wherein the controlling dispatching of resources comprisescontrolling dispatching of resources from at least one pool of resourcesof multiple pools of resources, and wherein the method furthercomprises: monitoring dispatching of resources from one or more pools ofresources of the multiple pools of resources to at least onehigh-priority thread of the computing environment; and based on themonitoring, dynamically adjusting one or more resource usage thresholdsassociated with one or more pools of resources of the multiple pools ofresources.
 7. The computer program product of claim 6, wherein themonitoring dispatching of resources from one or more pools of resourcesincludes monitoring dispatching of resources from the one pool ofresources, and wherein the dynamically adjusting one or more resourceusage thresholds includes dynamically adjusting the resource usagethreshold associated with the one pool of resources, and wherein thedynamically adjusting the resource usage threshold associated with theone pool of resources comprises dynamically adjusting the resource usagethreshold based on types of resources used by the at least onehigh-priority thread.
 8. The computer program product of claim 6,wherein the monitoring dispatching of resources from one or more poolsof resources includes monitoring dispatching of resources from the onepool of resources, and wherein the dynamically adjusting one or moreresource usage thresholds includes dynamically adjusting the resourceusage threshold associated with the one pool of resources, and whereinthe dynamically adjusting the resource usage threshold associated withthe one pool of resources comprises dynamically adjusting the resourceusage threshold based on whether the at least one high-priority threadencounters resource contention for one or more resources of the one poolof resources.
 9. The computer program product of claim 1, wherein thecontrolling dispatching of resources comprises controlling dispatchingof resources from at least one pool of resources of multiple pools ofresources, and wherein the method further comprises: monitoringdispatching of resources from one or more pools of resources of themultiple pools of resources to at least one low-priority thread of thecomputing environment; and based on the monitoring, dynamicallyadjusting one or more resource usage thresholds associated with one ormore pools of resources of the multiple pools of resources.
 10. A systemfor facilitating managing of resources in a computing environment, thesystem comprising: a memory; and a processor in communication with thememory, wherein the system is configured to perform a method, saidmethod comprising: controlling, by a hardware controller, dispatching ofresources from at least one pool of resources to be used in execution ofthreads, the controlling comprising: conditionally dispatching resourcesfrom one pool of resources of the at least one pool of resources to atleast one select-priority thread of the computing environment based onusage of resources in the one pool of resources relative to a resourceusage threshold associated with the one pool of resources, wherein theone pool of resources comprises resources of one selected type ofresource; monitoring dispatching and dispatching rate of resources fromthe one pool of resources; and based on the monitoring, dynamicallyadjusting the resource usage threshold associated with the one pool ofresources.
 11. The system of claim 10, wherein the select-prioritythread is a low-priority thread, and wherein the resource usagethreshold indicates a level at which dispatching of low-priority threadsis to at least be throttled.
 12. The system of claim 11, wherein theconditionally dispatching of resources from the one pool of resourcescomprises dynamically throttling a dispatch rate of resources from theone pool of resources to the at least one low-priority thread based onthe usage of resources in the one pool of resources exceeding theresource usage threshold associated with the one pool of resources. 13.The system of claim 10, wherein the controlling dispatching of resourcescomprises controlling dispatching of resources from at least one pool ofresources of multiple pools of resources, and wherein the method furthercomprises: monitoring dispatching of resources from one or more pools ofresources of the multiple pools of resources to at least onehigh-priority thread of the computing environment; and based on themonitoring, dynamically adjusting one or more resource usage thresholdsassociated with one or more pools of resources of the multiple pools ofresources.
 14. The system of claim 10, wherein the controllingdispatching of resources comprises controlling dispatching of resourcesfrom at least one pool of resources of multiple pools of resources, andwherein the method further comprises: monitoring dispatching ofresources from one or more pools of resources of the multiple pools ofresources to at least one low-priority thread of the computingenvironment; and based on the monitoring, dynamically adjusting one ormore resource usage thresholds associated with one or more pools ofresources of the multiple pools of resources.
 15. The computer system ofclaim 10, wherein the one pool of resources comprises resourcesexclusively of the one selected type of resource.
 16. Acomputer-implemented method of facilitating managing of resources in acomputing environment, the computer-implemented method comprising:controlling, by a hardware controller, dispatching of resources from atleast one pool of resources to be used in execution of threads, thecontrolling comprising: conditionally dispatching resources from onepool of resources of the at least one pool of resources to at least oneselect-priority thread of the computing environment based on usage ofresources in the one pool of resources relative to a resource usagethreshold associated with the one pool of resources, wherein the onepool of resources comprises resources of one selected type of resource;monitoring dispatching and dispatching rate of resources from the onepool of resources; and based on the monitoring, dynamically adjustingthe resource usage threshold associated with the one pool of resources.17. The computer-implemented method of claim 16, wherein theselect-priority thread is a low-priority thread, and wherein theresource usage threshold indicates a level at which dispatching oflow-priority threads is to at least be throttled.
 18. Thecomputer-implemented method of claim 17, wherein the conditionallydispatching of resources from the one pool of resources comprisesdynamically throttling a dispatch rate of resources from the one pool ofresources to the at least one low-priority thread based on the usage ofresources in the one pool of resources exceeding the resource usagethreshold associated with the one pool of resources.
 19. Thecomputer-implemented method of claim 16, wherein the controllingdispatching of resources comprises controlling dispatching of resourcesfrom at least one pool of resources of multiple pools of resources, andwherein the method further comprises: monitoring dispatching ofresources from one or more pools of resources of the multiple pools ofresources to at least one high-priority thread of the computingenvironment; and based on the monitoring, dynamically adjusting one ormore resource usage thresholds associated with one or more pools ofresources of the multiple pools of resources.
 20. Thecomputer-implemented method of claim 16, wherein the controllingdispatching of resources comprises controlling dispatching of resourcesfrom at least one pool of resources of multiple pools of resources, andwherein the method further comprises: monitoring dispatching ofresources from one or more pools of resources of the multiple pools ofresources to at least one low-priority thread of the computingenvironment; and based on the monitoring, dynamically adjusting one ormore resource usage thresholds associated with one or more pools ofresources of the multiple pools of resources.